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Relative entropy (divergence) of Bregman type recently proposed by T. D. Frank and Jan Naudts 
is considered and its quantum counterpart is used to calculate purity of the Werner state in nonex- 
tensive formalism. It has been observed that Bregman type divergence is suitable for q>l whereas 
Csiszar type is suitable for q£ (0, 1). It is then argued that the difference is due to the fact that 
the relative entropy of Bregman type is related to the first choice thermostatistics whereas the one 
of Csiszar type is related to the third choice thermostatistics. Moreover, it has been noted that 
these two measures show different qualitative behavior with respect to F due to the fact that these 
divergences being written compatible with different constraints. The possibility of writing a rela- 
tive entropy of Bregman type compatible with the third choice has been investigated further. The 
answer turns out to be negative as far as the usual transformation from ordinary probabilities to 
the escort probabilities are considered. 
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I. INTRODUCTION 



A nonextensive generalization of the standard Boltzmann-Gibbs (BG) entropy has been proposed by C. Tsallis 
in 1988 [1-4]. This new definition of entropy is given by 

S, = k (1) 

q-1 

where k is a positive constant which becomes the usual Boltzniann constant in the limit 1, p; is the probability of 

the system in the ith microstate, W is the total number of the configurations of the system. The entropic index q is 
a real number, which characterizes the degree of nonextensivity as can be seen from the following pseudo-additivity 
rule: 

Sg{A + B)/k = [S,{A)lk] + [S,{B)lk] + (1 - q)[S,{A)lk][S,{B)lk], (2) 

where A and B are two independent systems i.e., Py (A+B)=pi(yl)pj {B). As q— > 1, the nonextensive entropy definition 
in Eq. (1) becomes 

w 

Sq^i = -ks^Pi^npi, (3) 
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which is the usual BG entropy. This means that the definition of nonextensive entropy contains BG statistics as 
a special case. The cases q <1, q >1 and q = I correspond to superextensivity, subextensivity and extensivity, 
respectively. 

The nonextensive formalism is used in systems with long-ranged interactions, long-ranged memories, and systems 
which evolve in fractal-like space-time. Even though BG statistics can be used successfully in investigating extensive 
systems, physical systems such as Euler two-dimensional turbulence [5], high energy collisions [6-9], nematic liquid 
crystals [10], stellar polytropes [11], the nonisotropic rigid rotator model [12] and Fokker-Planck systems [13,14] can 
be given as examples for which the nonextensive formalism has been used successfully. 

From a mathematical point of view, the nonextensive formalism is being formulated by using the q-deformed 
logarithm and q-deformed exponential which can be given, respectively, as 



In, X = ^^5^^ exp<,a; = [1 + (1 - g)ar] . (4) 

These functions become the usual logarithmic and exponential functions as q— > 1. Moreover, other functions in 
common use can be generalized in a similar manner. For example q-sine function [15] can be defined as 



binaX= > —-, , (5 



where the function Q,n{<l) is given by 



Q„(g) = l.q.{2q - l).{3q - 2)...[nq - (n - 1)]. (6) 

J. Naudts [16-19] generalized the idea of q-deformed exponentials and logarithms to what is now called k— deformed 

exponentials i.e., expi^{x). A deformed exponential is a convex function with a value of one when its argument is 
zero. It is also equal to or greater than zero for all real arguments. The k— deformed logarithm is defined in a similar 
manner. By choosing a k— deformed logarithm as 

ln«(a;) = (l + -)(a;'*- 1) -1<k<1, (7) 

and its inverse function as 



exp,(x) = [l + ^a;]^^ (8) 

where [x]+ = max{0,a;} , one immediately obtains the nonextensive formalism by setting k equal to (q-1). For 
AC = 0, they become the usual logarithmic and exponential function respectively. 

Likewise, if one chooses for the deformed exponential 

exp^(a;) = [kx + ^/l + k^x^]^/'' -1 <k<1 and k ^ 0, (9) 
and the deformed logarithm as 

ln,{x) = ^{x'^ - X-), (10) 

one obtains Kaniadakis 'deformed functions [20]. Again, in the limit k = 0. these functions coincide with the usual 
logarithmic and exponential functions. In the sense emphasized above, both of the Tsallis and Kaniadakis formalisms 
can be explained within the scheme of deformed functions approach proposed by Jan Naudts. 

In Section II, we use quantum divergences in the nonextensive formalism in order to calculate the purity of state in 
the case of Werner states. We show that each of them provides us with a different answer. This difference is resolved 
by considering the first and third choices of internal energy constraint. Our final observation is related to the fact 
that there is no nonextensive relative entropy expression of Bregman type which is compatible with third choice of 
constraint. We summarize the results in Section III. 
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II. RELATIVE ENTROPIES, FIDELITY AND CONSTRAINTS 



One particularly important concept is the one of relative entropy: In extensive statistics, the physical meaning of 
relative entropy is the free energy difference. In addition to this, it plays a very decisive role in the context of the 
second law of thermodynamics in the nonextensive formalism. Indeed, Abe and Rajagopal showed that there might 
be expected a violation of the second law if the nonextensive index q is not in the range (0,2] [21]. To be able to do 
this, they made use of the nonextensive relative entropy definition of Csiszar type [22] 

^,(p|k) = ^ [rr(pV-«)-i]. (11) 

Recently, J. Naudts [18] and T. D. Frank [14, 23] gave an alternative definition of relative entropy of Bregman type 
[24] which reads 

D^{P II ^) = ^ \Tr{p'^) - Tr{po'^-^)] - [Tr(pa«-i) - Tr(a«)]. (12) 

S. Abe [25] made use of Eq. (11) in order to calculate the purity of Werner state in the nonextensive framework. 
For this purpose, he used Werner state [26] which is given by the density matrix 

p^^ = F|*-)(*- I +l^(|*+)(*+ ] + !$+)($+ I + !$-)($- I), \<F<1 (13) 

where 

I = ^(1 +-)± I -+)), (14) 

and 

l*^)^^(l++)±|— »• (15) 

F is the fidelity of pw with respect to the pure reference state a =| '^~){'^~ \ . For the time being, we restrict 
ourselves to the interval qG (0,1) since Eqs. (11) and (12) should not be too sensitive to small eigenvalues of the 
matrices as in Ref [25]. If we substitute Werner states in order to find the degree of purity with respect to a in 
Eq.(ll), we obtain 

/,(pw III *-)(*- I) = Y^(i-n. (16) 

Indeed, this is the result already obtained by Abe in Ref. [25]. Let us consider the alternative definition of quantum 

divergence proposed by Naudts and T. D. Frank in Eq. (12) and repeat the above calculation by substituting a, as 
defined earlier. First, let us consider the first two terms on the right hand side of Eq. (12) 

Tr(p« - pa^-i) = ^(z I (p« - pa«-i) | z), (17) 



For the second term, we have 



= Tr(p«) IpI*-). 



(18) 
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Tr(p(7«-i - (7«) = ^{i I (po-«-i - (T«) I i) = I p I - (^r- I ^f-). (19) 



Summing all the terms above, we obtain 

D,ip Ik) = ^ [Trip') - I P I *")] -i^f-lp] *-) + I (20) 
Next, we make use of Werner states pw instead of the generic p in the expression above and obtain 



D,{P Ik) = ^ IF' + 3(^^)' -F]-{F- 1). (21) 

Obviously, Eq. (21) is different from Eq. (16). It leads to negative values for qe (0, 1) and F smaller than 1. This 

apparent difference, at first glance, may look like a possible inconsistency in the nonextensive formalism, but let us 
look closer at these two different relative entropy expressions i.e., Eqs. (11) and (12) by trying to solve them within 
a perturbative approach. The reason for this is to ensure that all eigenvalues of a are different than zero. From now 
on, we do not have to restrict ourselves to any particular interval of q as long as it is not equal to 1. In order to do 
this, let us rewrite a as 

a = (1 - e) I I +|(1- I I). (22) 

This definition of a corresponds to our earlier definition when we set e equal to zero. If we recalculate Eqs. (11) 
and (12) now, we obtain 

I.iPw II a) = ^[(1 - eyP" + e'-^il - Ff - 1)], (23) 
whereas Frank-Naudts version, we have 

D,{pw Ik) = ^ [F« + 3i-«(l-i^)«-(l-e)«-iF-(|)«-i(l-i^)]-(l-e)«-iF-(|)«-i(l-F) + (l-e)« + 3i-«e«. 

(24) 

Now let us consider the limit e ^ for these two distinct expressions of divergence assuming F to be between 
and 1. Then, for qS (0, 1), we obtain 

I,{pw\\o) = ^^{l-F'i). (25) 

and 

Dq{pw \\ (t) = +<x. (26) 
On the other hand, for q values greater than 1, wc have 

Iq{Pw II <y) = +00. (27) 

and 

D,{pw Ik) = ^ [F' + 3(^^)'' -F]-{F- 1). (28) 
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In order to understand the difference between Eqs. (11) and (12), we consider first the maximization of the 
functional 

^ordinary = Sg - a(^Pi - 1) - /3(^p,ei - [Z"''*""'-!'), (29) 
i i 

where the superscript "ordinary" indicates that we are using ordinary expectation values. The equation above 
provides us the following solution 

-^rdinary ^ ^ _ ^^gordinary-^l/(q-l) ^ _ ?-^(}/{ei - Uordinary^^yil-1)^ 

where tilda denotes that this particular expression is calculated in terms of the maximum entropy distribution 

-^rdinary ^ ^, ^^^^^ 



A 

ord 

If the normalized q-expectation value [27] is employed, the functional to be maximized will be of the form 



/3/ = ^. . (31) 

/ — ordinary \n ^ ' 



^normalized = Sq - a(^ft - 1) - " t/"°"""'*^'='') , (32) 

which gives 



^normalized [1 -|- (1 g'^i^normalized'^l/{l—q) ^'[^ q)/3*(£- jjnormalized'^'^^/i^—Q) (33) 



where 



E/ ~ normaLize0j \ n 
iipi r 



P* = r , ■ (34) 



If we now substitute p^'-^^'^'^'^v given by Eq. (23) into Eq. (12), we obtain 



Dq{p II pi"'-'^™'^'^?') = f3(^FOrd^nary _ pordinary^^ (35^ 

i.e., the relative entropy of Bregman type is nothing but the difference of free energies when the ordinary expectation 
value is considered. This result has been derived also by T. D. Frank [28] by using a different technique than the one 
adopted in this paper. Similarly, if we now substitute Eq_ (26) into Eq. (11), we get 



J ^ II ^ normalized-^ p*^ ^jpnormalized pnormalized^^ (36) 



where /3** = ^ ^^^oi^lu^^d-^g P- Eq. (29) shows us that the relative entropy of Csiszar type is nothing but the 

difference of free energies when the normalized q-expectation value is being used. Therefore, as far as their physical 
meanings are concerned, these two relative entropies are the same as Csiszar type, being connected with the normalized 
q-expectation values and Bregman type is depending on ordinary expectation values (for details, see Ref. [29]). 

One can consider writing Eq. (28) in terms of normalized q-expectation values as is suggested by J. Naudts: This 
is tantamount to rewriting Eq. (22) by changing ordinary probability distributions to escort probability distributions 
and replacing q by 1/q. The escort probability distribution, which will be obtained after the maximization, must then 
be substituted into the following quantum divergence of Bregman type 
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D,{p II a) = ^^y^ [Tr{p"'^) - Tr(p<7(V«)-i)] _ TrCpa^V-^)-!) _ Tr{a'h). (37) 

If one now substitutes the new escort probability distribution which is obtained by the substitutions Pi — > v = Pi 

and q—^l/q into the equation above, we obtain the same free energy difference which has been obtained in Eq. (28) 
but this time with terms such as F^o'''"o/jzed ^-^^ pnormahzed J normahzed free energy expressions. This prima 
facie looks like the solution to our problem: We have obtained a relative entropy expresion in accordance with the 
third constraint, simply making some minor changes in the form of Eq. (12) and in the maximization procedure as 
explained above. This apparently simple solution has two flaws: First of all, in the last maximization procedure, we 
have used Pi = 1. But, this simply means that wc have chosen it as a constraint in our maximization. Now 

reminding ourselves that Wa- = Pi , we see that what we used as a constraint is nothing but an identity. If we choose 

to use this normalization as a constraint, then we must treat Pi as an independent variable. Once this had been 
assumed, the entropy written in terms of P^s will be a new entropy which is different from Tsallis entropy. Secondly, 
Sg(P) occurs to be nonconcave in some intervals which has been shown by Abe [30] and Di Sisto et al. [31]. All these 
observations make it clear that we still do not have a plausible relative entropy definition of Bregman type. 

III. RESULTS AND DISCUSSIONS 

We have studied two definitions of relative entropy in current use in the nonextensive formalism. We have calculated 
the degree of purification of Werner state using quantum divergence as recently proposed by Jan Naudts and T. D. 
Frank and showed that it provides us a result different from the one obtained by S. Abe in Ref. [25] using the 
quantum divergence of Csiszar type. This difference is traced to the fact that one of Bregman type is written in a way 
compatible with the first choice and the other is compatible with the third choice of constraint in the nonextensive 
formalism. The Bregman type gives rise to solutions for q values greater than 1 and F smaller than 1 whereas Csiszar 
type is suitable for q values between and 1. They differ in their qualitative behavior too because the Bregman type 
decreases as fidelity F decreases while the Csiszar type increases as F decreases. This too is related to the choice 
of constraints. The problem of writing a relative entropy expression of Bregman type in the nonextensive formalism 
compatible with the third constraint is still an open question for further research. 
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